An Applied Examination of Methods for Detecting Differential Distractor Functioning
نویسندگان
چکیده
This study applied the odds-ratio (Penfield, 2008), the multinomial logistic regression (Kato et al., 2009), and the standardised distractor analysis (Schmitt and Bleistein, 1987) methods in the examination of differential distractor functioning (DDF) effects. Using data from the administration of one statewide mathematics assessment, these methods were applied to provide insight into two research questions; 1) whether the magnitude and pattern of the DDF effect is constant across all methods; 2) whether the pattern of DDF effects supports differential item functioning (DIF) findings. While some differences in results were found, all three methods present a viable option for use in improving test items included in statewide assessment programmes.
منابع مشابه
Partial Differential Equations applied to Medical Image Segmentation
This paper presents an application of partial differential equations(PDEs) for the segmentation of abdominal and thoracic aortic in CTA datasets. An important challenge in reliably detecting aortic is the need to overcome problems associated with intensity inhomogeneities. Level sets are part of an important class of methods that utilize partial differential equations (PDEs) and have been exte...
متن کاملA confirmatory study of Differential Item Functioning on EFL reading comprehension
The present study aimed at investigating DIF sources on an EFL reading comprehension test. Accordingly, 2 DIF detection methods, logistic regression (LR) and item response theory (IRT), were used to flag emergent DIF of 203 (110 females & 93 males) Iranian EFL examinees’ performance on a reading comprehension test. Seven hypothetical DIF sources were examin...
متن کاملSelecting the Best Fit Model in Cognitive Diagnostic Assessment: Differential Item Functioning Detection in the Reading Comprehension of the PhD Nationwide Admission Test
This study was an attemptto provide detailed information of the strengths and weaknesses of test takers‟ real ability through cognitive diagnostic assessment, and to detect differential item functioning in each test item. The rationale for using CDA was that it estimates an item‟s discrimination power, whereas clas- sical test theory or item response theory depicts between rather within item mu...
متن کاملDifferential Item Functioning (DIF) in Terms of Gender in the Reading Comprehension Subtest of a High-Stakes Test
Validation is an important enterprise especially when a test is a high stakes one. Demographic variables like gender and field of study can affect test results and interpretations. Differential Item Functioning (DIF) is a way to make sure that a test does not favor one group of test takers over the others. This study investigated DIF in terms of gender in the reading comprehension subtest (35 i...
متن کاملInterpreting the Validity of a High-Stakes Test in Light of the Argument-Based Framework: Implications for Test Improvement
The validity of large-scale assessments may be compromised, partly due to their content inappropriateness or construct underrepresentation. Few validity studies have focused on such assessments within an argument-based framework. This study analyzed the domain description and evaluation inference of the Ph.D. Entrance Exam of ELT (PEEE) sat by Ph.D. examinees (n = 999) in 2014 in Iran....
متن کامل